A Conceptual Model and Specification Language for Mixed Reality Interface Components

This paper presents a uniform approach for specifying mixed reality user interfaces, including 3D interaction techniques and 3D widgets. Our main goal is to facilitate the process of reusing previous work, so more complex applications can be built and documented in a formal and uniform way. Our work builds on previous experiences and taxonomies in related fields. Our specification method is described at two levels: a conceptual model and a specification language. The conceptual model provides means to generalize user interface components and to port them to different hardware settings and application contexts. An XML-based specification language implements the conceptual model and allows for automatic processing and tool support. Several examples show main features of the proposed representation and demonstrate the applicability of both model and language to different mixed reality user interfaces, including Desktop VR, Immersive VR, and Augmented Reality. CR Categories: I.3.6 [Computer Graphics]: Methodology and Techniques—Languages D.2.1 [Software Engineering]: Requirements/Specifications—Languages;